Multimodal Development in Children's Narrative Speech: Evidence for Tight Gesture-Speech Temporal Alignment Patterns as Early as 5 Years Old.

PURPOSE: This study aims to analyze the development of gesture-speech temporal alignment patterns in children's narrative speech from a longitudinal perspective and, specifically, the potential differences between different gesture types, namely, gestures that imagistically portray or refer to semantic content in speech (i.e., referential gestures) and those that lack semantic content (i.e., non-referential gestures). METHOD: This study uses an audiovisual corpus of narrative productions (n = 332) from 83 children (43 girls, 40 boys) who participated in a narrative retelling task at two time points in development (at 5-6 and 7-9 years of age). The 332 narratives were coded for both manual co-speech gesture types and prosody. Gestural annotations included gesture phasing (i.e., preparation, stroke, hold, and recovery) and gesture types (in terms of referentiality, i.e., referential and non-referential), whereas prosodic annotations included pitch-accented syllables. RESULTS: Results revealed that by ages 5-6 years, children already temporally aligned the stroke of both referential and non-referential gestures with pitch-accented syllables, showing no significant differences between these two gesture types. CONCLUSIONS: The results of the present study contribute to the view that both referential and non-referential gestures are aligned with pitch accentuation, and therefore, this is not only a characteristic of non-referential gestures. Our results also add support to McNeill's phonological synchronization rule from a developmental perspective and indirectly back up recent theories about the biomechanics of gesture-speech alignment, suggesting that this is an inherent ability of oral communication.

Bridging the Gap Between Prosody and Pragmatics: The Acquisition of Pragmatic Prosody in the Preschool Years and Its Relation With Theory of Mind.

While it is well known that prosodic features are central in the conveyance of pragmatic meaning across languages, developmental research has assessed a narrow set of pragmatic functions of prosody. Research on prosodic development has focused on early infancy, with the subsequent preschool ages and beyond having received less attention. This study sets out to explore how young preschoolers develop the ability to use prosody to express pragmatic meanings while taking into account children's Theory of Mind (ToM) development. Though ToM has been suggested to be linked to the development of receptive prosody, little is known about its relationship with expressive prosodic skills. A total of 102 3- to 4-year-old Catalan-speaking children were assessed for their pragmatic prosody skills using 35 picture-supported prompts revolving around a variety of social scenarios, as well as for their ToM skills. The responses were analyzed for prosodic appropriateness. The analyses revealed that 3- to 4-year-olds successfully produced prosody to encode basic expressive acts and unbiased speech acts such as information-seeking questions. Yet they had more trouble with complex expressive acts and biased speech acts such as the ones that convey speakers' beliefs. Further analyses showed that ToM alone is not sufficient to explain children's prosodic score, but the prosodic performance in some pragmatic areas (unbiased pragmatic meanings) was predicted by the interaction between ToM and age. Overall, this evidence for the acquisition of pragmatic prosody by young preschoolers demonstrates the importance of bridging the gap between prosody and pragmatics when accounting for prosodic developmental profiles, as well as taking into account the potential influence of ToM and other socio-cognitive and language skills in this development.

The Predictive Value of Non-Referential Beat Gestures: Early Use in Parent-Child Interactions Predicts Narrative Abilities at 5 Years of Age.

A longitudinal study with 45 children (Hispanic, 13%; non-Hispanic, 87%) investigated whether the early production of non-referential beat and flip gestures, as opposed to referential iconic gestures, in parent-child naturalistic interactions from 14 to 58 months old predicts narrative abilities at age 5. Results revealed that only non-referential beats significantly (p < .01) predicted later narrative productions. The pragmatic functions of the children's speech that accompany these gestures were also analyzed in a representative sample of 18 parent-child dyads, revealing that beats were typically associated with biased assertions or questions. These findings show that the early use of beats predicts narrative abilities later in development, and suggest that this relation is likely due to the pragmatic-structuring function that beats reflect in early discourse.

The Value of Non-Referential Gestures: A Systematic Review of Their Cognitive and Linguistic Effects in Children's Language Development.

Speakers produce both referential gestures, which depict properties of a referent, and non-referential gestures, which lack semantic content. While a large number of studies have demonstrated the cognitive and linguistic benefits of referential gestures as well as their precursor and predictive role in both typically developing (TD) and non-TD children, less is known about non-referential gestures in cognitive and complex linguistic domains, such as narrative development. This paper is a systematic review and narrative synthesis of the research concerned with assessing the effects of non-referential gestures in such domains. A search of the literature turned up 11 studies, collectively involving 898 2- to 8-year-old TD children. Although they yielded contradictory evidence, pointing to the need for further investigations, the results of the six studies-in which experimental tasks and materials were pragmatically based-revealed that non-referential gestures not only enhance information recall and narrative comprehension but also act as predictors and causal mechanisms for narrative performance. This suggests that their bootstrapping role in language development is due to the fact that they have important discourse-pragmatic functions that help frame discourse. These findings should be of particular interest to teachers and future studies could extend their impact to non-TD children.

Children Use Non-referential Gestures in Narrative Speech to Mark Discourse Elements Which Update Common Ground.

While recent studies have claimed that non-referential gestures (i.e., gestures that do not visually represent any semantic content in speech) are used to mark discourse-new and/or -accessible referents and focused information in adult speech, to our knowledge, no prior investigation has studied the relationship between information structure (IS) and gesture referentiality in children's narrative speech from a developmental perspective. A longitudinal database consisting of 332 narratives performed by 83 children at two different time points in development was coded for IS and gesture referentiality (i.e., referential and non-referential gestures). Results revealed that at both time points, both referential and non-referential gestures were produced more with information that moves discourse forward (i.e., focus) and predication (i.e., comment) rather than topical or background information. Further, at 7-9 years of age, children tended to use more non-referential gestures to mark focus and comment constituents than referential gestures. In terms of the marking of the newness of discourse referents, non-referential gestures already seem to play a key role at 5-6 years old, whereas referential gestures did not show any patterns. This relationship was even stronger at 7-9 years old. All in all, our findings offer supporting evidence that in contrast with referential gestures, non-referential gestures have been found to play a key role in marking IS, and that the development of this relationship solidifies at a period in development that coincides with a spurt in non-referential gesture production.

Encouraging kids to beat: Children's beat gesture production boosts their narrative performance.

Gesture is an integral part of language development. While recent evidence shows that observing a speaker who is simultaneously producing beat gestures helps preschoolers remember and understand information and also improves the production of oral narratives, little is known about the potential value of encouraging children to produce beat gestures-as opposed to merely observing them. In this between-subjects pretest-posttest training study we examine whether encouraging children to produce beats can boost their narrative performance. A total of 47 5- to 6-year-old children were divided into two groups and exposed to a training session in which a total of six stories were presented under one of two experimental conditions: (a) the children merely observed video-recordings of a storyteller who used beat gestures and were then asked to retell the narratives; or (b) the children observed the same video-recordings and then retold the narratives but were encouraged to simultaneously use their hands in the same way the storytellers did. Pretests and posttests consisting of children's narrations of short animated cartoons were analysed for narrative structure and fluency. A comparison of scores showed that children in the group that had been encouraged to use beat gestures in the training phase performed better in both narrative structure and fluency than the group of children who were simply asked to retell the story without gesture instruction. These findings suggest that linguistically relevant body movements serve to boost language development and that embodied storytelling can be of help in narrative training.

Observing storytellers who use rhythmic beat gestures improves children's narrative discourse performance.

Iconic and pointing gestures are important precursors of children's early language and cognitive development. While beat gestures seem to have positive effects on the recall of information by preschoolers, little is known about the potential beneficial effects of observing beat gestures on the development of children's narrative performance. We tested 44 5- and 6-year-old children in a between-subject study with a pretest-posttest design. After a pretest in which they were asked to retell the story of an animated cartoon they had watched, the children were exposed to a training session in which they observed an adult telling a total of 6 1-min stories under 2 between-subject experimental conditions: (a) a no-beat condition, where focal elements in the narratives were not highlighted by means of beat gestures; and (b) a beat condition, in which focal elements were highlighted by beat gestures. After the training session, a posttest was administered following the same procedure as the pretest. Narrative structure scores were independently coded from recordings of the pretest and posttest and subjected to statistical comparisons. The results revealed that children who were exposed to the beat condition showed a higher gain in narrative structure scores. This study thus shows for the first time that a brief training session with beat gestures has immediate benefits for children's narrative discourse performance. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Beat gestures help preschoolers recall and comprehend discourse information.

Although the positive effects of iconic gestures on word recall and comprehension by children have been clearly established, less is known about the benefits of beat gestures (rhythmic hand/arm movements produced together with prominent prosody). This study investigated (a) whether beat gestures combined with prosodic information help children recall contrastively focused words as well as information related to those words in a child-directed discourse (Experiment 1) and (b) whether the presence of beat gestures helps children comprehend a narrative discourse (Experiment 2). In Experiment 1, 51 4-year-olds were exposed to a total of three short stories with contrastive words presented in three conditions, namely with prominence in both speech and gesture, prominence in speech only, and nonprominent speech. Results of a recall task showed that (a) children remembered more words when exposed to prominence in both speech and gesture than in either of the other two conditions and that (b) children were more likely to remember information related to those words when the words were associated with beat gestures. In Experiment 2, 55 5- and 6-year-olds were presented with six narratives with target items either produced with prosodic prominence but no beat gestures or produced with both prosodic prominence and beat gestures. Results of a comprehension task demonstrated that stories told with beat gestures were comprehended better by children. Together, these results constitute evidence that beat gestures help preschoolers not only to recall discourse information but also to comprehend it.